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Abstract 

A logit model predicting student outcomes for a gateway course, Math for 
Liberal Arts, was successfully developed which fits the data well. Two 
variables, ACT math score and high school GPA, were found to be significant 
predictors of achieving a C or better in Math for Liberal Arts. A practical 
implication of the study suggests that with just two pieces of information, a 
student's high school GPA and his/her ACT math score, a counselor could 
input these two values into a spreadsheet and obtain the student's predicted 
probability of success in Math for Liberal Arts. 
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I ntroduction 

Gateway courses are extremely important for students to make adequate 
progress toward successful graduation. In order to meet higher 
expectations to compete in a global economy it is important for community 
colleges to develop strategies for improving the rate at which academically 
underprepared students take and pass initial college- level (or "gatekeeper”) 
courses. As the great majority of institutions of higher education require 
successful completion of general education courses it is vital for colleges to 
assess factors that may predict student success and use that information for 
counseling and placement in appropriate courses that maximize student 
potential for success. 

This study examines the impact of important predictors of success in a 
gateway course in mathematics at North Iowa Area Community College. The 
odds and probabilities associated with the predictors of success in the 
gateway mathematics course are measured through a logistic regression 
analysis. While this is an institutional study the factors predicting student 
success in the identified mathematics gatekeeper course may well be 
common to many community colleges. Implications for appropriate 
placement based on success probabilities and odds are also examined. 

Literature Review 

It is a common practice for colleges and universities to identify students 
as under-prepared for a college-level course based on standardized 
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placement scores (Kozeracki, 2002). A single measure alone has often been 
used to determine course level placement. A large body of research has 
focused on the analysis of ACT (American College Testing) scores. The 
cognitive factors that have been most widely considered as potential 
predictors of college mathematics achievement are the SAT (Standard 
Achievement Testing) and ACT scores (Benford & Gess-Newsome, 2006). 

According to Golfin, Jordan, Hull, and Ruffin (2005), colleges generally 
require a score of at least 23 on the mathematical component of the ACT to 
be allowed to enroll in a college algebra class. Duranczyk and Higbee 
(2006) revealed that only 41% of students graduating from high school in 
2005 scored a 22 or higher on the ACT math test, indicating they had a high 
probability of succeeding in college algebra. That leaves a potential of 59% 
majority pool of incoming high school graduates whose low ACT math scores 
predict a less than favorable outcome in succeeding in mathematics gateway 
courses. Kozeracki (2002) revealed that 55% of community colleges 
reported that the number of students in developmental studies has 
increased over the previous 5 years. Several states; Arizona, Colorado, 
Florida, Oklahoma, South Dakota, Tennessee, and West Virginia, have 
established an ACT math score of 19 or 20 as the minimum score necessary 
for students to enroll in college-level mathematics courses. 

Kohler (1973) determined that ACT math and composite score are 
significant predictors of grades in college algebra. Twenty years later, House 
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(1995) revealed that the ACT composite score is a significant predictor of 
grades in a variety of introductory college mathematics courses. Gussett 
(1974) determined there is a strong correlation between SAT total (math 
and verbal combined) score and the grades in freshman-level mathematics 
courses. Bridgeman (1982) revealed significant relationships between SAT 
math score and student achievement in college algebra and finite 
mathematics. Jenkins, Jaggars and Roska (2009) found a substantial 
proportion of students with high placement test scores did not take 
gatekeeper courses. 

Findings from other studies have revealed that combining admissions 
test scores with high school performance data can be used to successfully 
predict grades in a variety of college math courses. Richards et al. (1966) 
posited that high school grades are good predictors of college math grades, 
especially when combined with ACT scores. Noble and Sawyer (1989) 
revealed similar results in six college math courses using a combination of 
ACT composite scores and high school GPAs (Grade Point Average). Benford 
and Gess-Newsome (2006) posited that students' high school GPA and ACT 
scores are good predictors of grades in gateway courses. 

While several researchers have revealed that standardized test scores 
and high school grades are effective predictors of success in college 
mathematics, some researchers have revealed contrary findings. Haase and 
Caffrey (1983a, b) posited that high school grades were generally useless as 
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predictors of grades in introductory mathematics courses, and that SAT and 
ACT score did not predict overall scholastic achievement in community 
college. Yellott (1981) conducted a study that revealed neither the ACT or 
results from the Mathematic Association of America's Placement Program 
predicted success in university level developmental mathematics courses. 
The Mathematic Association of America's Placement Program offers a 
collection of standardized tests which aid in the recommendation of course 
placement. Despite these contrary findings, the majority of researchers 
tended to agree that standardized test scores and high school grades are 
effective predictors of success in mathematics courses. 

Some research studies investigated more comprehensive approaches to 
devising placement standards. Lewallen (1994) used multiple measures to 
determine placement of students in courses. Variables examined to 
determine a relationship with course success were: age, high school grade 
point average, high school completion status, recency of formal schooling, 
years of high school math and grade in last math course, highest level of 
math class completed, recency of last math class, and units planned and 
work hours planned. Leweallen concluded that course success was strongly 
associated with high school grade point average, highest math class 
completed, grade in last math class, units planned, and recency of school. 

I llich, Hagan, and McCallister (2004) conducted a study of students enrolled 
in remedial courses along with regular college courses and concluded there 
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are potential problems in predicting success when one relies on only one 
measure (e.g., standardized placement tests) to assess the preparatory 
needs of students. Their results were consistent with other findings 
indicating that student dispositional data better predict academic 
performance than standardized placement tests. Using standardized tests 
does not take into consideration a student's motivation to learn. 

Felder, Finney, and Kirst (2007) conducted a study at American River 
College in California where the majority (90%) of students who began with a 
developmental [i.e., mathematics] course did not pass a transfer-level 
course. In 2004, American River College replaced traditional placement with 
an "informed self-placement" model for mathematics courses. Instead of 
placing students into courses based on test scores, self- placement is 
designed to match American River College math course content. Students 
take the level of math test they perceive best matches their skill level, and 
receive computer results immediately following the test. Counselors use the 
self-placement test results to advise students for appropriate course 
selection. Prior to the self-placement process, American River College relied 
on COMPASS test scores to determine math course placement. While the 
results from COMPASS and the self-placement assessment are similar, 
faculty and administration favor the self- placement assessment tool 
primarily due to the flexibility of the instrument and its cost. Whereas 
COMPASS is a fixed exam that must be purchased from ACT, faculty and 
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counselors are able to customize the self-placement instrument (e.g., make 
updates and additions) to best fit each student's needs. 

Several researchers have revealed that subject-specific placement exams 
written and administered by the same institutions that taught the math 
courses are the best predictors of student performance (Bone, 1981; Crooks, 
1980; Helmick, 1983; Schultz & Austin, 1987). 

In a study of 73 underprepared mathematics students Rochester 
Community College, Mercer (1995) revealed that students who followed the 
counselor's advice and were placed in a developmental mathematics course 
based on skill assessment scores were more likely to pass the entry college 
level mathematics course. This finding indicates that a developmental 
course can successfully prepare the student for a college level mathematics 
course. 

A study was conducted at Cottey College, Missouri, to determine why a 
large number of students were dropping basic algebra and calculus classes 
(Callahan, 1993). The study focused on predictive variables, specifically 
standardized test scores, for success in basic algebra. Recommendations 
were made based on the finding of this study. For students with four years 
of high school math, the ACT score was considered for appropriate course 
placement. Students with only one year of high school math, and many with 
two or three years but test scores below 18 ACT and 400 SAT, would benefit 
from Intermediate Algebra. Within two years of establishing the program 
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based on the study recommendations, the college saw improvements in 
mathematics course pass rates (Callahan, 1993). 

The complexity of the published work supports the necessity to conduct 
site specific research with frequent reevaluations (Mercer, 1995). 

Purpose 

The purpose of this study is to conduct site specific research to predict 
success in a gateway mathematics course at North Iowa Area Community 
College. Based on the literature review and availability of data we posit 
three variables impact the odds of success in the gateway course. These 
three variables are ACT math score, high school GPA and number of high 
school math courses taken. 

Data 

The data for this study was obtained from an analysis of students 
enrolled in a gateway course, Math for Liberal Arts, during the 2006-07 
college year at North Iowa Area Community College. Complete information 
on high school GPA, ACT math scores, number of high school math courses 
taken and success in Math for Liberal Arts was obtained for 275 students. 



The variables in this analysis are summarized in Table 1: 
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Table 1 

Variable Names. Description and Coding 



Variable Names 


Descriotion 


Codina 


Math_Success 


A 'C' or better as a final 
student grade in Math for 
Liberal Arts 


Dummy coded: 

1 = Success 
0 = Not successful 


ACTM 


Student ACT math score 


Reported by ACT 


HSGPA 


Student high school 
grade point average 


Reported from high 
school 


NUMB 


Number of high school 
math courses taken by 
student 


Reported from high 
school 



Research Hypotheses 

The following null and research hypotheses were tested: 



Ho - Math_Success is jointly independent of the predictors, ACTM, 
HSGPA and NUMB, simultaneously; H 0 : 3i = (3 2 = p 3 = 0. 

Hi - ACTM, HSGPA and NUMB independently and simultaneously effect 
Math_Success. 

Research Methods 

Logistic Regression. As the dependent variable, Math_Success, is a 
binary categorical variable and because we are interested in controlling for 
important variables that impact the odds of math success the analytical tool 
of choice is logistic regression. Logistic regression is "the most important 
model for categorical response data” (Agresti, 2002, p.165). 
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Logistic regression applies maximum likelihood estimation after 
transforming the dependent into a logit variable (the natural log of the odds 
of the dependent variable, Math_Success, occurring or not). In this way, 
logistic regression estimates the probability of success in Math for Liberal 
Arts, controlling for important predictor variables. 

Findings 

Characteristics of the Sample. The sample split for students who succeed 
versus those who did not succeed in Math for Liberal Arts is identified in 
Table 2. 

Table 2 

Sample Split Accelerated and Non- Accelerated Students 



Group 


N 


Percent 


Succeeded 


137 


49.82 


Did Not Succeed 


138 


50.18 


Total 


275 


100.00 



Table 2 indicates that the sample is evenly distributed for those that 
succeeded versus those who did not succeed in Math for Liberal Arts. Table 
3 depicts descriptive statistics for the variables of this study. 
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Table 3 

Descriptive Statistics 



Variable 


Mean 


Std. Dev. 


Min 


Max 


Math Success 


0.49 


0.50 


0.00 


1.00 


ACTM 


18.43 


2.86 


13.00 


28.00 


HSGPA 


2.68 


0.58 


1.09 


3.89 


NUMB 


4.16 


1.36 


0.00 


8.00 



Logit Model for Math Success 

The specified logit model has three predictors of Math_Success: 

■ ACT math (ACTM) 

■ High school gpa (HSGPA) 

■ Number of high school math courses taken (NUMB) 

The logit model is formally expressed as follows: 

¥rob(Math _ Success = 1 1 (x)) = A, (a + [5 X ACTM + J3 2 HSGPA + fi,NUMB ) 

where X{ ) is the logit function, exp(x)/(l + exp(x)), a is the constant and /?, 

represent logistic coefficients for each predictor variable. The effects can be 
simply stated as the odds ratio. 

All statistical analyses were conducted utilizing Stata version 11 and 
SPost (Long & Freese, 2006). The logistic model specified above produced 



the following results. 
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Table 4 

Logistic Regression Parameter Estimates 





Coef. 


Std. Err. 


Z 


P>z 


[95% Conf 


1 nterval] 


ACTM 


0.13 


0.057 


2.32 


0.021 


0.020 


0.244 


HSGPA 


1.87 


0.299 


6.23 


0.000 


1.280 


2.456 


NUMB 


-0.09 


0.107 


-0.89 


0.376 


-0.304 


0.115 


_cons 


-7.04 


1.205 


-5.84 


0.000 


-9.406 


-4.682 



Note. Likelihood- ratio (LR) = 71.84 with 3 df; p=0.000 
Naglekerke's R-square = 0.308 



The model appears to be significant but it is observed that NUMB, the 
number of high school math courses taken, is not significantly different from 
zero, p=.376. As such, we drop this variable from the analysis and recast 
the model as follows: 

Prob(Math _ Success - 1 1 (x)) = A(a + J3 X ACTM + /3 2 HSGPA ) 

The revised logistic regression produced the following parameter 
estimates (Table 5) and odds ratio estimates (Table 6). 






